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SUMMARY PAGE 


Th need for cupplomantery noncegnitive becky round Information In the solection 
of naval eviution students has become Increasingly evident. Recent exit Interviows 
vith studont pilots wie have voluntarily withdrawn from training Indicate that foctors 
unrelated to mantal cb! lity (euch ao atiltude toward the military) often entered into 
. thotr dvelsions. This study wes conducted to determine If Incluston of the noncognitive 
Itoma of tho collegs and fight bockgreund questionnaires would enhance the validity 
of the exleting primory eolection precest, thus raduelng the current ottrilon mito. 
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FINDINGS 


f 

Certain Items of the college and fight background quettlonnalres, whon 

coupled with the reeldual validity of the extsting selection tests, were found to 
Inerecea the predictive validity of the current selection systam. The prediction 

equation developed on hulf of the sample wast successfully crossvolidated with the 
romaining half. implemantetion of the suggested technique would have reduced tho 

attdition rte by 4.5 porcentags polnts In the cross-validation sample. Thus, It wos 
racemmendad that this technieue be Incorporated as a management tool at the primary 


salectlon levol. 
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INTROBUCTION 


Tho treditiena! poychatogical calection Instrumonis uillized for naval aviation 
efucents are primarily cognliive in nzturo. The underlying asumpiion ts that [fan 
epplicent has the montal and physical cepabl lity, he can succeed In flight tralning. 
The Nevy currently employs o bottory of four selection tests and o flight phystcal for 
iis pumpesn. Tha ests ero the Aviation Qualification Test (AQT), the Mechanical 
Comprohancton fest (MCT), the Spatial Apparception Test (SAT), end the Boyraphical 
lavontory (BI). Tho lest Is the enly cae In which a noncegnitlve approach Is applied. 


Racont oxlt Interviews with navol oviation students who hove voluntarily 
crapped From tho flight program Indicate that factors unrelated to mental ability often 
ontersd Into thelr declien. This hes led to the notion thet supplementory noncognitivo 
kackground information may prove beneficial in the selection process. 


Thle paper roperts an Inveetlgetion of the effectiveness of the Flight Background 
Questionnel re (F8Q) and the College Background Questlounolre (CBQ) In the estab- 
lishment of an additional stendord for the elimination of « greater proportion of 
cpplicants with the lecst Itkelihood of success, thus decreasing the current attrition 
ete and Improving cost effectlivences In aviation training. A previous study conducted 
et tho Navel Aercepace Medical Institute found college mofor to be predictive of 
cvecess In the Filght program (3). At the time of that study the CBQ was developed (2). 
Subsequently, tha FBQ wus constructed (1) with o format elmilar to thar of the CBQ. 
These Instrunionts were designed to provids a meons of exploring background Informae 
tien ralevan? to the successful completion of flight tralning. 


FROCEDURE 


MATERIALS , 


The C8Q Ie composed of the questions that covor the following teples: 1) tho 
fight level of educntion attalneds 2) college major; 3) the type of school attencad 
(o.g., ataite supported, church afffllated, or private); 4) the number of stuctonts 
attending the college) 5) the number of colleges attended; 6) grada polnt overage, 

7) tha numbor of times one changed ecademic malor 8) the geegraphical lecotion of 
the college where one completed the mojor port of his work; and 9) whather or not o12 
kas 6 teacher's certlfleste. Each Item hos two or more alternatives, the most belng 
tan. Only one caluction Is made for each quection. wnall, there ore 59 olternailvas 


eeress the nine ttem:. 


The F8Q Is slilerly constructed ond Is composed of five Items. These 
include: 1) experlence es an airline pasesnger, 2) experience os on alrcrewman, 
3) provieus fiigh? inatructien, 4) collegiate aviation oct! vities, and 3) the oge at which 
one first became motivated to go Into military aviction. There are 22 alternot! ves 


ecress tho five items. 


OF Hie 81 altomatives cons wore climineted end cavaral wore combl ned to 
make up 22 sepsrate oxpormanial Itoms. The reduction of the CBC) wos boscd In pare 
on cn unpublished [tom enalysts by Potoron, Lane and Booth. Sinca no previous work 
had beon dene on tho FEQ, tho Items wore cllowad to stand as they existed except for 
6 fow minor changes. fioma answored In the effirmatlve wore scored with a value of | 
Gad @ nogstlve ressenco wos cesrad es 0. 


SUBJECTS 


The study sample consleted of 1207 aviation offf cer candidates (AOC's) who 
entered Aight tralning ducing calender years 1966 ond 1967. AOC's ore typically 
rocent callege greduates procured diractly from civilian life and, os a result, 
gonorally have no provieut ~lltary exserdance. They represent the largest sing!o 
source of Input to naval ovvcnon tralning and also account for much of the attrition. 
Atte tion here refers to those students who were removed from training becouse of 
acadamic or flight diffteulties end those who voluntadly withdrew from the program. 
Thoso who did not complete for roatorns other than those mentioned above, such os 
madical or disciplinary problems, were excluded from the analysis. OF this samplo, 
759 Anished trelaing and 438 aftrted. 


HYPOTHESIS 


{t was expocted that the Inclusion of the nencogal tive college and flight 
background Information In the Initial selection process would significantly enhance the 
validity of the currant calection process ond thus reduce the rate of attrition. Con= 
firmation of this hypothaes!s should leod to the Implementation of a cut-off-score 
approach to salection. This cut-off score would represent a minimum stendard required 
for solec.tion. This technique would hopefully reduce tha current attdtion rate ond 
thus rasult In a valuable savings to the Nevy. 


DATA ANALYSIS 


Tho sample wes divided Inte two graups by on edd<oven method. Half wore 
utillzod for the Initial anolyals, and the remainder for crocavalidation. The tnital 
validation sample cendsted of 602 students, 375 of whom completed and 227 of whom 
atirlted. Tho creee-volidation sample consisted of 605 students, 394 of whom comp!sted 
end 211 of whom eticlted. Two multiple correlation coafflelents wera caleulated for 
the Initiol romplo with the complete-ettdite dichotomy used as the criterion. Tha firt 
multiple corrolation esom!nad the primary selection tests only, ond the second Inctuded 
both the primary selection teste and the experimental C8Q ond FEQ Iteme with exch Item 
treated 3 a seperate variable. This was dene to determine whether or net the Incluslon 
of the exsedmental variables significently Increcsed the multiple corolation coafftclent. 
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Rogrocton scorse (sxedlatoz seesca) wore thon computed with the regression 
woiphia ebtalned from tho first caante for each subject In the crecs-validation sample. 
The pont blesdel eomoletion esofictent between theze predictor scores end tha 
complote-atirite celforion carvod cs on Index of ereasvalidatton. 


The final step wes to damonstrate tho utility of the Incluston of the CEQ snd 
FCQ itera In the celection proces: by compiling actuarial desta. This wes dons by 
dividirg the cross-validation tample Into these who completed and these who did no? 
complote. Soparate frequenay distributions of predictor scores wore set up for each 
group. The frequency detributtons Indicated the percentage of those who completod 
end the porcontege of thee who ottrited et or below a given predictor ssere. fn this 
manner, a cutting score that would ellminate the maximum number of potential 
hs er walla allowing fer the retention of the grectost number of "completes" could 
Bie, ideati fled, 


RESULTS AND DISCUSSION 


A review of the dosertpilve statistics from the Initial validation sample ts 
Inchuded In Tebles | end I. Tha moons and standard deviations of the primary selocifen 
vanebles are Included In Yeble 1, with thelr peint bleaital corratetions with the 
completecattrite crf terten. 


Table | 


Statistics from faltial Validation Semple 
with Regard to Primary Selection Tests 


Yeot Rosa 8. d. r 
AQT 64.430 11.444 048 
MCT 60.437 7,337 77* 
SAY 22.131 4.674 034 
Bi 39.937 12.588 o1l4i* 


® Significant beyond the .0! level 
N 2 602 


These correlations coprscen? the resicval validity of the eelsetion foots. That fs, 
thalr abSllty to predict to @ erltoren fer o group thot hed previously been screened by 


3 


weet anton 


Wiese samo mecourcse Tobto ff fats fer tho expertmantal Itaws ca the CSQ end FOG hia 
prepertion of the falticl velidstion comple reagending In the offirmativo and Its pil 
ecoffictont? with tie altaden. 


feblo 9 


Propesicn of Initial Validation Sample Roszonding to 
Bech Expodmental CBQ end FBQ liom end Resnoctive 
Corvatetions (oh!) with the Complets-Atirite Criterten 


Experimenta! tiem Presortion Responding 


College motor (rath, prytl es, engineering, RAI. Acad.) 0173 2076 


College wee or (bustrezs, SON o » hist., poll. sol.) 0429 ~,016 
College prpulation grester than 16,000 228 073 
Attended three or mere colleges 093 ~.087 
Grado peint avemgs 2.00°2.49 822 162 
Grads pair? Gverage 2.80~2.99 0067 ~ 069 
Changed ceademic mater loes then twice B19 024 
College lecated In East, Scuth, Centro! State 08) ~ 016 
College located In Pacific State 573 085 
Flown less then twiea commercially 085 083 
Flown more than ntno hour commercially 738 069 
Flown light plane, but not solo 056 013 
Solead light plans, but no private license 038 033 
ica pelveto livarse... . 4085 ol tS? 
Kes commercial Mleonss .010 0078 
Momber ef college flying club 073 ". 
Age flirt motivated to fly In ral ltarys 
22 or older «254 = 079 
18-2) 496 oOTT 
9-17 098 7 OVO 
V4-16 047 2010 
12 Or younger .043 O46 
Nevor eure about desi rm 08} 014 


® Significant boyend the .05 levol 
N = 692 
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Altheugh caly ens of tho ph} values Is statistloally significant, many of the 
Hors ore Indopandzat ef cach thar, end It Is posttble that they ean combine to result 
ine meoniagtul multiple coroletica eaofficlont. Tha eomaleto sor-ordar correlati sn 
rates Is procontod in Agsandlx A. 


Vables i ead (V Nlustrato the rcoultant Inercaco In predictive valldity ebtal nod 
by the eddlticn cf the CBQ end FEQ variables. The multiple correlation of tha 
eotectton tests aleno Is glvon In Yeble Itt. This valuo represents the restdval validity 
rcaslting from tho Interaction of tho MCT ond 81. The fact that the 8) was selected as 
6 prsdiator varlable suasests the notlen thet noncognitive measures have untepped 
pororttel es tndicanis of eventue! tuccoss In filgh? training. Table IV summarizes the 
cutput of tho muitip!s correlation, using the two selactlon tests ond the exporimanial 
Itoms os procilctors 


Tho scevltan? coofitclont ts significantly greater than that obtalnad by tho 
election tests olens (p< .01). Table IV alco lists the voriebles thot were selectod os 
prodletoss of the criterion. Of the 11 C8Q and F8Q variables selected, elght wore 
selgned posltive weights end thros were assigned negotive weights. The fact that tho 
ltom “Mombar of college flying club” wes exlgned o negative welgh? was some cause 
fer consorn, copseiclly In view of Its significant positive correlation with “Privete 
pilots Neenso" (200 Agsendix A). Typleally, theee vadebles appearing In the latter 
pontens of a multiple coralation llsting are unstable and should not be accepted 
without question. wos dacided, however, to repest all of the avallable informatica 
in this onalysts; 20, these feat few varlobles were Incluced In the computation of 
prodieter sescess. Apnendix B lists the weights assigned each predictor variablo end 
the computation of presictor ecores Is exolalned there I) detall, 


The rooults abtetned for tha Initiol validation samale were uphold hy crass 
validotien. The predicter scores coloulated for the cross-velldation comple had e poln? 
blearal corrplation coofficioant of .193 with the complete-attrite criterion (p< .001}. 
This may be Interproted o3 an Indicatlen of tha validity of the selected C8Q and FEQ 
Itoma combined with tha MCT ond Bt fer en Independent tangle. 


Tatslo 


Maltisto Polnt-Bicarlal Cunmstarten botwaen Soloctod 
Astituds Tests aad CenaletacAtiite Critceton * 


Solected Antttuds Test Shiunken R FeVeluo 
RACT 0W73 19,443 
Bi oaal 12.914 
em = 602 


Teble IV 


Multiole Palnt-Bleedal Comelaticn betwoen the Aptitude Tests (MCT and 8), 


tho CB#Q end FED fromm, and tho Complete=Attrite Criterion® 


Sotected Actituda Tests ond Shrunkon R= FeValue 
CBEQ-F2Q troms 

hACT AZ 19.443 
a 22) 12.914 
Geeda polnt average 2.002 .49 239 6.364 
Private pile? Neanee 25) 4.893 
Msitivation to fly eliltary sines ago 22°° 0263 4.969 
Attendsd three or moro callegzes** 0270 3.264 
College legsted tna Paci fe Cocat siate "878 = 3 905 
Commorctal ptict's licens 284 3.235 
Flown lees than twlee commercially 29) 3.284 
Meombse of college Mying elud°?* 0295 2.674 
Motivation to fly milltary ance ego 139-17 298 2.182 
Attaaded collega wth moro then 14,000 students 300 2.076 


Activation to fly military slnes bafora ege 12 301 1.087 


ony = 2 
%¢ Pssloned a negative welgh} 
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Gaso vall€stica wee ostatlishod, a lec 

HCA WES Cculishod, @ preetleat epollestion of the Andinns wos 
oxsmincd » Vable V licis cn ebridced vemten of the frequency dlatributlons of pro~ 
caer} ecssas tha? ware computed (or tho cemalotes and attrites of the crocsovalldaiten 
COED e 


Teblo V 


_. Facqusney Distdbutlen of Procleter Scores 
Fer Comzicias and Attrites of CrecaeVelidation Somple (IN = 605) 


& of Attdtes % of Camplotcs 
Fiedletc Seci0e Eslew Cerracnonding Bolow Corresponding 
Fisfietor Secre Piodi ctor Scora 
656 1 \ 
761 " 3 
846 4 16 


owe &® &@ & ow ee Yo ob we eereenmeee®ek@eeemeewedeseenene © ® eo wb ® 


936 49 cd 
126i 77 64 
1133 90 84 
1258 9 94 
(2st 100 8) 
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Segarate cumulative perconicges of completes and attrites ore prosonted for 
roprosontattve predictor eceres. An examination of these dota revealed that cutting a? 
a podieter score of 844 would provide for tho elfmination of 34 par cont of the 
aftrites at © coat of 16 por cont ef the completes. The lees of the potential succosess 
con be called solaction errar or falco posttives. Since parfoct predictors have yat to 
ba davalagsd, salection systome must operate with o cortalm amount ef error. Ina 
High eupalycolow damand sltvation en organization can afford very stringent selection. 
Tha faleo poeltives who cze rejected would be in excess of the demands of the selector. 
The convene ts tuo, of couse, when the supply end damond situation Is revered. 
Another factor to be concidored ts tho doller cost of felse negatives (those who were 
eolected and thea attrited). Duo ts the extreme expense of training « tingle naval 
avlovor It Is Jucicleus to elicinate potential fallures as early as possible. Hada 
cutting esora of 266 bson In effect, the attrition rete of the cross-validation somple 
would have been reduced from 34.7 per cent to 30.2 por cont. This raduction of 4.5 
rercentege polis amounts te o 13 por cont reduction of the original attrition rete. 
Thio wauld caprosant @ barge savings to the Navy Inasmuch os It could bs Implemontod 
ot the receulter levol of esloction. 


Another mothed of utilaing the predicter score approach Ip demonstrated In 
Yeblo Vi. Horo, the porcontago of candidates completing flight tralning fs shown fer 
given prodlater scére Intorvols. Theugh there is come fluctuation due to error of 
moseurement, In general tho higher tho predictor Interval, the greater proportion of 
studonts congloting training. A teble such as this provides tho user with an estimate 
of the probsbllity of en explicent eucosesfully completing. For axomple, a candidsto 
with a predicter of 1200 may bs asaumed to heve approximately a 77 per cant chence cf 
finishing tho program. This type of teble can providas an additional objective Ingu? to 
the existing selection procecs, end can bo considered © potentlally useful manogoman’ 
teol ° 


TYedte VI 


For Cont Cewploting Flight Treintag of Incroscing Frodictor 
Secra Levels ® 


Prodictar Sco % Completing 


tntowel Nee Flight Tratatng 
69? cad balew 10 ds 7 20 
OD = 744 _— 27 37 
775 © OL 63 84 
G59 © G24 9% 68 
925 = WHY 1G3 68 
1680 = 1G74 180 64 
1675 = 114d 9§ vA] 
1150 - 1224 53 77 
1228 = 1209 as %6 
1300 and chove 18 83 


* Overall comaletica mato 65% 


©° fi} @ Vote! number of completes end atfrites within & glvon prodictor sear 
Intorval. 


CONCLUSION 


Tho hypothesis has kaca confirmed) namely, that the Incluslea of the none 
segalive Infommetica provided by the college and flight beckground questlonnalres 
would dentfizantly enhance the validity of the current colection process, thuo 
eoducing the attrition rato. Theso findings support the notlen thet It requlres moro thea 
wantal end phyclost abtitty te camalete fight tratning. Tho nencagnitive Informatica 
eppeer te wep fnetes in one's poronel hetery thet coatelbute to his over-all mokocup. 
Theugh such en oppreach dees not Arectly maesure Intelligence, aptitude, of abl lity, 
It does consider fects that epescr te be related to the tendency to sucesed In naval 
avietien talning. This tondeney ta epsarontly of grant Importence to ono's evecers 
In the pragcom. This te ovidented by the trend of voluntery withdrawals who hed tho 
required montal and phyclea! casub!litios but did no? pascocs o eufflelon? degrco of 
Hs fencoaey te suceced. 


Tha notion tha? noncega! tive predictor are useful hes boon evpported by tii 
ropected evecens of the Blegrephlcel inventory, the changing nature of roaent voluntacy 
withdsowale, end tho domonstrated utility of the C8Q ond FEQ. Hence, It Ie 
rocommonded that tho proposed cut-off sesro system be Implemented In the seloctica of 
raval eviction candidates. ly sheuld be noted, however, that this supplementary 
soleation epsresch wus doveloged on a semple thet had previously been sarsonod by 
the currant primary eotoction battory. Therofore, If Implemented, It should ba 
eomlaable enly te thee ezallcants who hed evevived the Initial selectlen precocs. 
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Appondx 8 


Teble B+! 


— Welghts end Censtont Utilized In the Computation 
of Predictor Scores® 


Grade pane averese 2.00 - 2.49 84 
Private pilot's lloenee 217 
Motivation to fly milttary since age 22 6; 
Attendad thre or more colleges “138 
Colleps located Ine Pacific Cozot state 95 
Commercial pilot's \tcanse 365 
Flown lees than twice commerctally 1” 

~126 


Member of college flying club 

Motivation to fly milltery since age 15 = 17 

Attended college with more then 16,000 students 
8 


Motivation to fly military since age 12 
Constonts +45 


* Predictor scores are coloulated os follows: The constent Is edded to the eum of tho 
products of the eneres on each pradloter vertoble and Ite respective weight. (Netor 
The CBQ end FIQ Items were scored with a value of "I" for on offirmatl ve response 
ond a value of "0" for @ negatlva responce.) The constant wor Included to eet the 
macn predictor ecore ot 1000. 


¢* Those weights are rounded whole number versons of thote ectually assigned each 
voriable by tha multiple correlation formula. This wae done to feelliteta computation. 
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\ the nood fer eupplomentery beckgcound Information In the selection of eudont novel 
evietere tes become Insreselagly evident. Recent ent Interviews with students whe heve 
velunterlty withdrawn from training Indieste thet fecton unreleted te mental er physl cal 
ability (aseh os oft!tude teward the military) often entered Inte thelr declstons.‘ S28 study 
utilized @ multiple eermlation oppreash te demeratrate tha? the tneluelen of neneugn! tive 
college end flight beckgreund Information weuld entianes the terultlvity of the seleetion 
precosss, thus reducing the oftritien rete. The Initiel results sonfresad this hypethesls ond re 
these Andinge were upheld by evecevelidotion, )implementatten of the suggectud techniqus =~" 
on recy eg ettritien rato by 4.5 percentage pointes for the ercsa-validetion 
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o Therefore, 2! lo recommended thot this tachnlque be Irnwonporeted ee manny 
teal ef the primary selsetion level. | 
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